DOCUMENT RESUME 



ED 060 039 



TM 001 122 



AUTHOR 

TITLE 

INSTITUTION 

PUB DATE 
NOTE 



L indell, Ebbe 

Composition in the Intermediate Stage of the 
Comprehensive School <FRIS> • 

Stockholm School of Education (Sweden) - Inst- of 
Educational Psychology. 

Jul 7 1 

8p. 



EDRS PRICE 
DESCRIPTORS 



IDENTIFIERS 



MF-S0.65 HC— $ 3-29 

♦Composition (Literary) ; ^Composition Skills 
(Literary) ; Creative Writing; ^Evaluation Criteria; 
Evaluation Techniques; Followup Studies; Grade 4; 
Grade 5; Grade 6; ^Language Research; Language Tests 
Linguistic Theory; Objective Tests; ♦Student 
Evaluation; Test Results; Visual Stimuli; Writing 
Skills 
♦Sweden 



ABSTRACT 

This news letter summarizes language research in 
composition, writing skills, and linguistic usage carried out over a 
three year period (Grades 4, 5, 6) with a sample of Swedish students 
Subjective assessment of student compositions was carried out- The 
marks from these assessments will serve as criteria In evaluating 
various objective measures- (CK) 
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1 . The Planning of the Pro j ect 

In a previous report (School Research Newsletter 1970:3) the motives 
for the project and its general planning were described. We need 
only recall that arguments concerned with composition ranged between 
two poles, often denoted by pairs of opposites such as restricted- 
free, reality-fantasy, training-therapy, communication-creativity. 

The work of documentation for the project has somewhat blighted our 
hopes of finding or formulating assessments which distinguish between 
the above-mentioned extremes. We are aiming at work which is very 
rich with regard to information} among other things profiled assess- 
ments have been made on an experimental basis but have shown very 
high reciprocal relationships (Page, E. & Paulus D. , 1968). 

2. Persons subject to Experimentation 

The project inoludes a follow-up stftdy of 3 years' duration of the 
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same pupils in the 4th-6th School Years. The pupils attend schools 
in Malmo. Prom certain points of view a nation wide sample would 
have been preferable. For other reasons we have felt obliged to reject 
this alternative. Work on essays and tests in connection with such 
essays requires direct contact between those conducting the experi- 
ments and the pupils. The selection has, however, been made with an 
eye to disparate social structures in the districts served by the 
schools. The basis of the selection has been an investigation by 
Swedner and Edstrand (1969). In all the sample comprises pupils of 
9 classes in 5 schools. The first composition was written by 229 
pupils, the tests for the school year provided data for 249 * 

5. The First Composition 

5.1 The Subject 

Intermediate stage textbooks contain many suggestions for stimulat- 
ing pupils faced with composition. In the project special demands 
were made as to the choice of stimulus: 

- all pupils should be able to write something 

- an entirely free choice of subject could prove difficult for some 
pupils 

- on the other hand, the subject set should not be of so factual a 
nature that knowledge could prove decisive 

- in the case of a free choice, the stimulus applied should not be 
too binding, e.g. a series of pictures which could easily result in 
a fixed number of similar sentences. 

In order to obtain material of interest to the pupils we studied 
Iiindsten" s (1969) registers of interesting themes. These suggest 
that subjects such as animals and the history of development appeal 
to pupils. We chose as a stimulus a picture rich in detail having 
a motif of this type, the cover page of a Swedish weekly magazine. 
Certain hints as to headings were also given but the pupils were 
entirely free to write their own ideas. 

It is not altogether oertain whether this subject was really the 
best choice, in the sense of that likely to yield the richest 
production. We did, however, observe that all the pupils did in 
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fact ■write something. Testing different types of stimuli will be 
the subject of later experimental studies. These, however, will 
prove more reliable after this year’s investigation has provided 
us with information as to the measurements which can be applied 
for objective evaluation. 

3.2 Marking 

A subjective assessment of the compositions in their entirety has 
been carried out. The marks will serve as criteria in the evaluat- 
ion of various objective measurements. According to Bjomsson (i 960 ) 
at least 3 assessors are necessary to attain over 0.90 reliability. 
Ma-i-Vg awarded by lecturers in methodology and education are at 
present available, while marks awarded by intermediate stage teacherr: 
are being collected. The lecturers show high mutual reciprocity, 
between 0.70 and 0.73« 

3.3 Objective Measurements direct from Compositions 

It would be an advantage if objective measurements could be obtained 
from the pupils' compositions without its being necessary to make 
use of subjective assessments and without recourse to analyses re- 
quiring expert treatment. The investigation referred to above by 
Page & Paulus affords encouragement on this point. In weighing up 
a numb er of quantitative measurements taken from the compositions 
it proved possible to obtain the same degree of accuracy i i assess- 
ment as is achieved when independent assessors award marks. Among 
conceivable measurements may be mentioned! 

Total number of words 

Number of different words 

Number of different punctuation marks 

Length of sentences, median value and standard deviation 
Length of words, median value and standard deviation 

Some twenty measurements of similar type can be determined. By means 
of correlation calculations between these on a reciprocal basis and 
using marks as criteria, it is possible to work out simple and 
multiple correlations. 
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3.4 Linguistic Analysis 



The analysis of lexical and syntactical phenomena is based on Tele- 
man's suggestions ( 1971 )- 4 schedule for analysing exrors has been 
worked out by Hultman. The work involved is performed with the aid 
of special forms and an extensive system of symbols. We do not 
intend to give examples of these things here but instead we cite an 
extract in clair showing what the analyses will lead to (the example 
has not yet been treated by linguists and it is possible that the 
terminology will be amended) . 



Swedish 

Text 


English 

Text 


Lexical Analysis 


Syntactical 

Analysis 


Analysis of 
Errors 


En 


One 


indef. art. 


advb of time, 
art. 




da g 


day 


sub 


advb of time 




sa 


said 


vb, pret. 


finite vb 




lararen 


the 

teacher 


sub, def.ari in 

post-position, 

person 


subj . 




(bisats) 


(clause) 


that-clause 


aco.obj • 


comma missing 


att 


that 


conjunction 






vi 


we 


pers . pron. 


subj . 




skole 


should 


vb, pret. 


finite vb 


spelling mis- 
takes - 

- change vowel, 
add consonant 
(skulle) 




go 


vb, ing. 






till 


to 


advb of place, 
prep 






Bmseumet 


the 

museum 


sub, def.art.in 
pos t-pos ition 


advb of place 


word formation 
(museet) 


Observe that 


punctuation marks are given lines of their 


own. Certain 



additions are made to the text, in the case above with reference to 
the clause. A very large number of measurements and combinations of 
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measurements are possible by means of analyses of this type. It has 
not yet been decided what measurements will be chosen and it is also 
probable that the first processings will lead to the introduction of 
fresh ideas. 

3*5 The Evaluation of Objective Measurements 

It is of importance for the future work of the project that it should 
prove possible to replace marks by objective measurements. It would 
probably be to the advantage of the daily work of the school if such 
measurements could be indicated. Preliminarily, however, assessments 
by teachers must serve as criteria. 

Before selecting measurements the following points of view may be 
noted: 

1 • Which measurements are reliable? It is likely that a certain 
frequency is required before a measurement can be used. Individual 
constructions can vary from essay to essay by the same writer. 

2 . Pace validity must be noted. Even if characteristics such as 
spelling and handwriting correlate positively with the criteria, 
it is open to discussion whether they should be included in the 
assessments. Or should this be done with respect to training in 
writing, which can well be applied to both correct spelling and 
neat handwriting? 

3. The measurements should be chosen with a view to the teacher f s 
contribution. One motive for this project is to provide teachers 
with more and increasingly objective measurements, but these should 
not be too complicated to draw up. 

4. The. measurements should be chosen so that the pupils may be 
guided by them. A measurement such as the length of the composition 
would thus be unsuitable, whereas measurements such as the length of 
sentences and variety of words would be preferable from the point of 
view of instruction. 
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5. Are combinations of subjective and objective measurements 
suitable? Calculations made for the purposes of evaluation imply 
for the most part correlations on the one hand between the objective 
measurements reciprocally, on the other with the mark criteria. By 
objective measurements we mean both those taken directly from the 
compositions as well as those obtained by means of the linguistic 
analyses. Other ways of obtaining 1 multiple correlations with crite- 
ria will also be employed. 

4* Tests 

4*1 Content of the Tests 

The tests make it possible to survey certain hypothesis with respect 
to the pupils. Furthermore, the compositions provided some informa- 
tion on difficulties experienced by the pupils in dealing with the 
language. These difficulties could be investigated more formally by 
means of the tests We decided to concentrate on problems concerned 
with language teaching in the case of the Ath Year pupils. The sched- 
ule followed in field work gives a survey of the content of the 
measurements . 

First Day 

First Period: 

Berhagen' s intelligence test: series of pictures, filling up, 
classification, puzzles, linguistic analogies. 

Second Period: 

Style test Adjectives ^ , Parsing, Attitudes in accordance with 
Likert Scale. 

Second day 

First Period: 

Grammatical correctness and Outline in accordance with older standard 
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Second Period: 

xJ. Command of vocabulary A(d,iectives) , Style test V(erbs), Attitudes 
in accordance with comparisons of pairs. 

4-2 The Relation of the Tests to the Compositions 

Both collections of data make it possible to compare passive profi- 
ciency according to the tests with active proficiency according to 
the compositions. Such points of comparison are to be found in, for 
example, variety of vocabulary, grammatical correctness and parsing. 

We are planning investigations to analyse factors in the choice of 
measurements. Conventional tests as references to the interpretation 
of factors would facilitate the definition of factors. 

Attitude tests will be subjected to a separate factor analysis, 
which in its turn can indicate some aspects of personal disposition 
to composition. 

Before we undertake further experimental investigations the tests 
make it possible for us to mainrain essential hypothesis under control. 

i 

5. Differential Investigations 

As mentioned under "Persons subject to Experimentation", the schools 
baking part were selected with a view to ensuring that the pupils 
should have different social backgrounds. In the investigations 
concerned with the analysis of variance some of the causes of vari- 
ance will therefore be social background and intelligence, possibly 
also sex* In a recently published work (Turner & Mohan, 1970), mention 
has been made of a series of possibilities of replacing by objective 
measurements certain of Bernstein* s observations of linguistic usage 
in different social environments. 

During the ensuing academic year emphasis will be laid on experi- 
mental investigations of the importance of different types of stimuli 
fc.r written composition. The interesting causes of variation will 
then constitute "subjects". 
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